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SYNCHRONIZATION OF NODES 

BACKGROUND 

5 The present invention relates to the distribution of a time and frequency 

reference to radio base stations. More specifically, the present invention relates to 
an efficient way to distribute a frequency and time reference between nodes in a 
packet-switched network. 

In wireless communication systems, such as cellular telecommunications 

10 systems, radio base stations are typically interconnected by a packet-switched 

network. Radio base stations typically use a phase-lock loop, including a voltage 
controlled oscillator, to maintain frequency stability of the signals generated by the 
radio base stations. In conventional wireless systems, frequency stability of an 
oscillator in a radio base station is maintained using a frequency reference which 

15 is distributed to radio base stations over the packet-switched network using the 
pulse code modulated (PCM) reference, i.e. the frame synchronization signal in 
the El/Tl transmission protocol. For a more detailed explanation of PCM 
reference signals, the reader should refer to U.S. Patent No. 5,870,001 to 
Osterling et al., which is herein expressly incorporated by reference. The use of a 

20 . frequency reference ensures that the downlink signal generated by the voltage 
controlled oscillator is properly transmitted to a mobile terminal without 
interfering with other concurrently transmitted downlink signals, i.e., that the 
radio base station is transmitting to the mobile station over the correct frequency. 
As the sophistication of networking technology increases and the cost of 

25 implementation of these networking technologies decreases, radio base stations 

may soon be interconnected together using newer types of networks. These newer 
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types of networks may not necessarily contain the PCM reference which is present 
in the El/Tl transmission protocol. Since these networks may not contain the 
PCM reference, a new method for correcting the frequency drift of base station 
oscillators is needed. 
5 Conventional networking technologies use time stamp algorithms to 

distribute time. In TCP/IP based networks, the network time protocol is used to 
exchange time stamp messages between network nodes. However, the network 
time protocol only provides for the distribution of time and not the distribution of 
frequency as would be required for a radio base station. Further, the network 

10 time protocol considers all time stamp messages as equally accurate. Hence, the 
network time protocol does not take into consideration whether a transmitting 
node has a very accurate oscillator, e.g., a GPS receiver, or if the transmitting 
node has an inaccurate oscillator, e.g., a short-term stable free-running oscillator 
which has not been tuned for a long time. 

15 In addition, the network time protocol does not allow a node to receive 

frequency information from one node and time information from another. 
Further, network time protocol is designed for time stamping on an application 
layer which results in large uncertainties as to the accuracy of the time stamp. 
Since, radio base stations may soon be connected to each other through 

20 many other types of networks, e.g. ethernet networks, a new method for 

correcting the frequency drift of oscillators in radio base stations is required. 
Accordingly, it would be desirable to provide a reference frequency for radio base 
stations in networks which do not have a PCM reference signal. Further, it would 
be desirable to provide a method and apparatus for a node in a network to 

25 determine the accuracy of its oscillator. 
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SUMMARY 

These and other problems associated with cellular communications are 
solved by the present invention, wherein a network node adjusts the frequency 
drift of its oscillator based on time stamp message exchanges with other nodes. 
5 It is an object of the present invention to perform time stamping for the 

distribution of time and frequency in a packet-switched ethernet network on the 
physical layer. A common time is used for time transfer and a common interval is 
used for frequency distribution. 

It is another object of the present invention to include information about 

10 time stamp uncertainties in the time stamp messages. The time stamp uncertainty 
information takes into consideration such factors as whether the transmitting node 
is connected to a GPS receiver or whether the transmitting node uses a short-term, 
stable, free-running oscillator which has not been tuned for a long time. The 
receiving node takes into consideration the uncertainty of the information in 

15 determining the accuracy of the other nodes time stamp information. These 

uncertainty values include uncertainties regarding both the time transferred and the 
measurement of the common interval for frequency distribution. These 
uncertainties are compared to the uncertainty caused by the uneven delays of the 
network. In networks which require very accurate frequency references, like a 

20 GSM infrastructure, the network delays can be more evenly distributed than in an 
open network for which network time protocol was designed. Also, within a well- 
defined network segment, e.g. within a HUB, the delay can be considered small 
and constant. 

It is another object of the present invention to provide methods and 
25 apparatus for optimally combining frequency information received from one node 
and time information received from another node. This is particularly useful 
when a node is first placed into a network. The node which has been placed in the 
network can use frequency information from a node which has only an adequate 
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frequency reference (e.g. a stratum 2 oscillator). The time information can be 
received from a distant time server, which would have been too far away (network 
delay-wise) to provide a frequency reference for the oscillator of the node which 
has been started-up. 

5 It is yet another object of the present invention to provide improved fault 

analysis. Further, the present invention provides optimal usage of network 
resources. Each node optimally combines information it receives from other 
nodes relating to time and frequency along with the nodes own estimation of time 
and frequency. Each node can, based on uncertainty values provided with the 
'*4 10 time and frequency information from other nodes, determine which information is 

M high-quality information, and each node can discard poor-quality information. 

The filtered information is forwarded to all other nodes. In this way, any 
| ? a improvement of time or frequency at any node will be distributed to all other 

I'll; nodes. 

15 It is yet another object of the present invention to allow nodes to be peers 

and have multiple communication partners. This provides redundancy, so that if 
one node or one communication link fails, time and frequency information can be 
received from another node. Further, independent communication links will result 
in different, and uncorrected, transmission delay variations. The different 
20 transmission delay variations provide a diversity gain effect by using the 
information provided by the various communication partners. 

In accordance with one aspect of the present invention, the foregoing and 
other objects are achieved by a method and/or an apparatus for regulating a 
frequency deviation of an oscillator in the first node, in a network including a first 
25 node and a second node. A time stamp message is received at the second node 
from the first node. A reply time stamp message is transmitted from the second 
node to the first node, wherein the reply time stamp message includes a time of 
transmission of the reply time stamp message and the second node's estimation of 
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a time interval. An estimated frequency deviation of the oscillator in the first 
node is calculated using the second node's estimation of the time interval in the 
reply time stamp message. 

In accordance with another aspect of the present invention, the foregoing 
5 and other objects are achieved by a method and/or an apparatus by a network 
including a node. The node includes an oscillator and means for receiving time 
stamp messages. The node also includes a Kalman observer for determining a 
frequency deviation of the oscillator using information in a received time stamp 
message. 

10 In accordance with yet another aspect of the present invention, the forgoing 

and other objects are achieved by a method and/or apparatus for regulating an 
oscillator in a network node. A time stamp message is transmitted from a first 
node to a second node, wherein the time stamp message includes the first node's 
estimate of a time interval. In the second node, the time interval is estimated. A 

15 frequency of an oscillator in the second node is adjusted using the first node's 
estimate of the time interval and the second node's estimate of the time interval. 

In accordance with yet another aspect of the present invention, the forgoing 
and other objects are achieved by a method and/or apparatus for oscillator 
regulation. A network includes a first node, a second node and a third node. In 

20 the first node the length of time of a first time interval and the length of time of a 
second time interval is estimated. In the first node a time stamp message is 
received from the second node, wherein the time stamp message includes the 
second node's estimation of the first time interval. A time stamp message is 
received by the first node from the third node, wherein the time stamp message 

25 includes the third node's estimation of the second time interval. A frequency 

deviation of the oscillator of the first node is determined based on the first node's 
estimation of the first and second time intervals, the second node's estimation of 
the first time interval and the third node's estimation of the second time interval. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be described with reference to the 
accompanying drawings in which: 

Figure 1 illustrates an exemplary network and the interconnection of a 
5 plurality of radio base stations; 

Figure 2 illustrates an exemplary implementation of a radio base station 
node which operates in the exemplary network; 

Figure 3 illustrates the frequency drift of an oscillator over time; 

Figures 4 A and 4B illustrate a time stamp message exchange between two 
10 nodes according to an exemplary embodiment of the present invention; 

Figure 5 illustrates an exemplary time stamp message according to the 
present invention; 

Figure 6 illustrates an exemplary reply time stamp message according to 
the present invention; 

15 Figure 7 illustrates an exemplary absolute time message according to the 

present invention; 

Figure 8 illustrates an exemplary method for transmitting the time stamp 
messages; 

Figure 9 illustrates an exemplary method for reception of the time stamp 
20 messages; 

Figure 10 illustrates the frequency drift of an oscillator over time; 
Figure 11a illustrates a frequency point in a time stamp exchange between 
two nodes relative to a time stamp exchange with a third node; 

Figure 1 lb illustrates another frequency point in a time stamp exchange 
25 between two nodes relative to a time stamp exchange with a third node; 

Figure 12 illustrates an exemplary method for estimating an interval which 
includes a frequency point; 
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Figure 13 illustrates an exemplary method for estimating an interval which 
begins after a frequency point; 

Figure 14 illustrates an exemplary method for estimating the absolute time 
of an interval between time stamp exchanges; 
5 Figure 15 illustrates iterations of the Kalman observer from a frequency 

point to a new time point; 

Figure 16 illustrates an exemplary method for estimating the aging of an 
oscillator; 

Figure 17 illustrates an exemplary grouped network according to 
10 exemplary embodiments of the present invention; and 

Figure 18 illustrates an exemplary switched network according to 
exemplary embodiments of the present invention. 

DETAILED DESCRIPTION 

In the following description, for purposes of explanation and not 
15 limitation, specific details are set forth, such as particular circuits, circuit 

components, message formats, techniques, etc. in order to provide a thorough 
understanding of the present invention. However, it will be apparent to one 
skilled in the art that the present invention may be practiced in other embodiments 
that depart from these specific details. In other instances, detailed descriptions of 
20 well-known methods, devices, and circuits are omitted so as not to obscure the 
description of the present invention. 

Figure 1 illustrates an exemplary network which may be used to implement 
the present invention. The network comprises a backbone network 101 and nodes 
A-K. Nodes A-K communicate with each other over a backbone network 101. 
25 The communication links can either be on a physical layer, i.e., where the 

network is actually physically connecting the nodes, or on an application layer, 
i.e., where the nodes communicate via routers, switches and other devices. 
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According to an exemplary embodiment of the present invention, nodes A- 
J receive a list of nodes with which each node is to exchange time stamp messages 
from a central server node K. The perceived quality of the time stamp message 
interchange between nodes A-J can be reported continuously to the central node 
5 server K, which then can optimize the lists based upon factors such as proximity 
of the nodes and the accuracy of oscillators used by the nodes. 

The backbone network 101 can be implemented using any type of 
networking technology such as a synchronous or an asynchronous network, a 
packet-switched network or a circuit switched network. Of course, one skilled in 
'v| 10 the art will recognize that different methods of time stamping may apply for 

different implementations of the network layers. 

According to exemplary embodiments of the present invention, time stamp 
; 3 messages are interchanged between the nodes of the network to transfer 

ill information about absolute time and frequency. The time stamp message will 

?*i 15 contain a node's estimation of a time interval. The node which receives the time 

'"jj stamp message will compare its own estimate of the time interval with the estimate 

of the time interval in the received time stamp message. If it is assumed that the 
estimate of the time interval in the time stamp message is more accurate than the 
node's estimate of the time interval, any difference between the two estimations 
20 represents the frequency deviation of the oscillator. As will be described in more 
detail below, each node will determine a value associated with the node's 
uncertainty of its estimate of the time interval. The uncertainty value can be used 
to determine which estimate of the time interval is more accurate. As will be 
described in more detail below, these time stamp messages are used in various 
25 calculations by the nodes. The frequency of the oscillators in the various nodes is 
controlled based upon the results of these calculations . 

Figure 2 illustrates an exemplary node 200 for implementing the present 
invention. The node 200 includes a media access controller (MAC) 210, a 
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protocol manager (PM) 220, a random access memory (RAM) 230, a central 
processing unit (CPU) 240, an analog-to-digital (A/D) converter 250, a voltage 
controlled oscillator (VCO) 260, and a free running counter 270. Although MAC 
210, protocol manager 220, RAM 230, CPU 240, A/D converter 250, VCO 260 
5 and counter 270 are illustrated as discrete components, one skilled in the art will 
recognize that functions of these components can be combined either in hardware 
or in software. 

Messages are received by the node 200 from the network 201. The 
received messages are decoded by the MAC 210, which is part of the physical 

10 layer. The messages decoded by MAC 210 are passed to protocol manager 220. 
The protocol manager 220, which is part of the protocol layer, interprets the 
decoded messages. The protocol manager 220 passes the interpreted messages to 
RAM 230 for storage. Once the messages have been stored in RAM 230, the 
CPU 240 can access the messages for processing. 

15 With respect to a packet-switched network, one skilled in the art will 

recognize that the exact functions of the MAC and the protocol manager depend 
on the type of network being implemented. For example, in an ethernet based 
TCP/IP network, the MAC handles the ethernet layer, the protocol manager 
handles the IP layer and the CPU handles the TCP layer. Alternatively, in a 

20 circuit-switched network, the MAC can decode frame boundaries, and the protocol 
manager can extract and/or rearrange bits. 

VCO 260 clocks a free-running counter 270. The free-running counter 
270 holds the relative time of the node 200. The relative time of the node can be 
sampled by a signal connected to the SAMPLE-input 280. When SAMPLE-input 

25 280 is activated, the current counter value will be copied to a register 275. 
Register 275 is accessible by the CPU (and if necessary, to the Protocol 
Manager). The frequency of the VCO is controlled by software in the CPU 240 
via the A/D converter 250. 
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In general, time stamp messages are received in node 200. Based on the 
time stamp messages, CPU 240 controls VCO 260 in order to maintain an 
accurate frequency reference for node 200. Since accurate updating of the 
oscillator, depends on accuracy of the time stamp messages, the time stamping 
5 shall preferably be performed on the physical layer. For example, in an ethernet 
based network the time stamping shall be done by the ethernet media access 
controller 210 for both transmission and reception time stamps. 

Although exemplary embodiments of the present invention have been 
described as beginning the transmission of the time stamp message on the physical 
10 layer, one skilled in the art will recognize that other methods for beginning the 
transmission can be implemented. For example, according to one alternative 
method, the protocol manager 220 sends a signal over path 292 to counter 270 
indicating that the current value in the counter 270 should be sampled. The signal 
is sent from protocol manager 220 to the counter 270 when the MAC 210 is 
15 instructed to transmit the first bit of the message. According to a second 

alternative method, the CPU 240 sends a signal over path 294 indicating that the 
current counter value should be sampled. The signal is sent from the CPU 240 to 
the counter 270 when the protocol manager 220 is instructed to transmit a message 
which is stored in RAM 230. In all three methods, the CPU 240 reads and stores 
20 the sampled counter value and uses the sampled counter value as the time 
corresponding to the time stamp message transmission. 

Although exemplary embodiments of the present invention describe time 
stamping occurring at the beginning of transmission of a time stamp message, one 
skilled in the art will recognize that other predetermined common time events can 
25 be used for time stamping, e.g., the end of transmission of a time stamp message. 

In the first and second methods the CPU 240 forms the contents of the time 
stamp message and stores it in RAM 230. When the time stamp message is 
transmitted, the CPU 240 might be occupied with other tasks and cannot be 
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interrupted. Accordingly, the CPU 240 may not be able to copy the contents of 
the register 275 into the message before that part of the message is actually 
transmitted. The problem which arises from this can be addressed in different 
ways. First, the protocol manager 220 may read the contents of the register 275 
5 and insert the contents in the proper place in the time stamp message. Any 

necessary formula for converting the register value to absolute time is included in 
the time stamp message or executed by the protocol manager 220. Alternatively, 
the time stamp message may be divided into two separate sub-messages. The first 
sub-message is a short message which contains only a sequence number and the 

10 time of transmission is used for triggering time stamping, while second sub- 
message, which is formed shortly after the first sub-message, contains the 
information about when the first sub-message was transmitted. Accordingly, the 
CPU 240 will then have the necessary time to read the register 275, calculate the 
absolute time of transmission, and formulate the second message. 

15 When a time stamp message is received by a node, the node will perform a 

reception time stamp to calculate the network delay. The time stamping of a 
message upon reception is performed by sampling the counter value at the time of 
reception. There are three alternate methods for accomplishing the time stamping 
of a message upon reception. According to the first method, the MAC 210 sends 

20 a sample signal over path 290 to the counter 270. The sample signal is sent when 
the MAC 210 samples the first bit of a received message. The protocol manager 
220 then "confirms" that it has interpreted the message to be a time stamp message 
addressed to this particular node. Alternatively, the confirmation is performed by 
the MAC 210 if the message uses a MAC address which is associated with the 

25 node 200. Alternatively, in IP/ethernet based networks the MAC 210 confirms 
the message only if the MAC 210 also determines that the message is dedicated 
for time stamp messages. 
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The second method for accomplishing time stamping of a message upon 
reception involves the protocol manager 220. The protocol manager 220 sends a 
sample signal to the counter when enough of the message has been interpreted so 
that the protocol manager 220 can determine that the time stamp message was 
5 addressed to this particular node. 

According to the third method for accomplishing time stamping of a 
message upon reception, the CPU 240 sends a sample signal over path 294 to the 
counter 270. The sample signal is sent from the CPU 240 to the counter 270 
when enough of the message is interpreted by the CPU 240 to determine that the 

10 message is a time stamp message addressed to this particular node. For all three 
methods of reception time stamping described above, the CPU 240 reads and 
stores the sampled counter value and uses it as time of message reception. 

Now that an exemplary network for implementing the present invention has 
been described, a general overview of the operation of the present invention will 

15 be described in connection with figures 3 and 4. 

Figure 3 is a graph illustrating the frequency drift of an exemplary 
oscillator in a network node over time. The horizontal axis represents time and 
the vertical axis represents the deviation of the oscillator frequency of a node from 
the correct frequency. The graph illustrates how the oscillator frequency is 

20 drifting over time while a graph coincident with the horizontal axis would 
represent the correct frequency of the oscillator. Assume that at time 0 the 
oscillator has the correct frequency, as illustrated. As time passes, moving to the 
right on the horizontal axis, the oscillator frequency begins to drift from the 
correct frequency. During the time period between 0 and time point TP, the node 

25 exchanges time stamp messages with another node. The time point is a point in 
relative time when the last time stamp message in a time stamp message exchange 
period was transmitted. The absolute time calculated as a result of the exchange 
of time stamp messages is valid at this point. At time point TP, the node estimates 
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the frequency drift during the time period between time 0 and time TP , . As will 
be described in more detail below, when comparing intervals, the average 
frequency deviation and its derivative over the interval are calculated. Assuming 
linear drift of the oscillator, the average frequency deviation is in the middle of 
5 the interval. Accordingly, the estimated frequency drift is valid at the frequency 
point FPp The node stores the value of the node's counter at TPj and FP^ At 
TPj the node uses a control voltage to adjust the frequency of the oscillator based 
upon the estimated frequency drift of the node's oscillator. This is illustrated in 
figure 3 by the movement of the frequency drift toward the horizontal axis at time 

10 point TP^ 

During the time period between TPi and TP 2 the nodes continue to 
exchange time stamp messages. Also during the time period between TP { and 
TP 2 , the frequency of the oscillator begins to drift. Again, based upon the 
exchanged time stamp messages, the node adjusts the frequency of its oscillator at 

15 time point TP 2 . The nodes continue to exchange messages and adjust the 

frequency of their oscillators as illustrated by time point TP X . Although figure 3 
illustrates three frequency points, FP l5 FP 2 , FP X , as will be described in more 
detail below, once a new frequency point is established by the node, the prior 
frequency points are no longer valid. 

20 As discussed above, based on the messages exchanged between the nodes, 

each node can make certain predictions of the state of the system in the node. 
According to exemplary embodiments of the present invention a non-stationary 
Kalman observer is used to predict the values of the system state variables at 
different points in time. The Kalman observer can also be used to measure the 

25 time intervals between the exchange of time stamp messages. The Kalman 

observer is a time-discrete iterative algorithm for determining the state variable of 
a state space model of the system. One skilled in the art will recognize that the 
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Kalman observer can be implemented either in a CPU or in a dedicated digital 
signal processor. 

As will be described in more detail below, the Kalman observer will not 
iterate at fixed time intervals. Instead, the time intervals depend on when time 
stamp messages have been interchanged. Therefore, the boundaries of the time 
intervals are established when the node's oscillator frequency is updated, i.e., the 
time points illustrated in figure 3. Also, at the latest of these time points, the best 
estimate of absolute time will be known. 

The model of the current state in each node can be represented by the 
equation below: 



/ \ 



X= 



Time 
Frequency error 
^Frequency drift per time unit 



(1) 



wherein Xj is used to measure time intervals and to predict absolute time, x 2 and x 3 
are used to a model of the frequency drift of the oscillator over a period of time. 
A discrete time model of the system can be represented by the equation 

below: 

X =F X +G +V (2) 
k k k-1 k k W 



15 where F k and G k are matrices which model the system and can be represented by 
the equations below: 
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and where T k represents the number of oscillator cycles between two updates of 
the oscillator. Of course, one skilled in the art will recognize that the matrices for 
F k and G k will vary depending upon the type of system being modeled. One 
skilled in the art will also recognize that if the Kalman observer is used to iterate 
backwards in time, T k will have a negative value. 

V k represents the noise of the state model caused by the frequency drift of 
the oscillator and can be represented by the equation below: 



(4) 



where Q k can be represented by the equation below: 
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The values x ¥ l and T 2 represent the frequency deviation over time of the 
oscillator which is used as local reference in the node. These values are node 
specific because different nodes may use different types of oscillators. The value 
may be stored in a nonvolatile memory. 

To model different oscillators, the following values can be used: 

For a stratum 2 oscillator: 



Y y =4*10" 20 
Y -3.2-10" 27 

2 



(6) 
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For a stratum 3 oscillator: 



*F =1.6-10 
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¥,=3.2-10 " 2/ 

2 



(7) 



Of course, one skilled in the art will recognize that stratum 2 and stratum 3 
oscillators are merely exemplary types of oscillators and that if another type of 
oscillator is used that other values for x ¥ x and *F 2 can be used. 
5 A measurement made by the Kalman observer during the kth iteration can be 

represented by the following equation: 

y P jr H p x s n * (8) 



wherein H p is a matrix which depends upon whether the measurement y k is 
representing absolute time or frequency deviation, X k is the discrete model of the 
system and n k is the measurement noise of the measurement y k for the kth iteration 
10 of the Kalman observer, and may be represented by the equation: 

n k eN(p 9 R k ) (9) 



wherein N(0,RjJ is the normal distribution with the covariance R k . One skilled in 
the art will recognize that the measurement noise is the uncertainty of the accuracy 
of a measurement by the Kalman observer. This uncertainty can be represented by a 
variance value. For ease of explanation, the measurement noise will be herein 
15 referred to as the measurement uncertainty or measurement variance. 
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If the measurement made by the Kalman observer y p k during the kth iteration 
of the Kalman observer represents the absolute time when the time stamp messages 



H,=(l 0 0) 

If the measurement made by the Kalman observer y p k at time k represents the 
frequency deviation of the oscillator, then H p can be set equal to the vector below: 

H 2 =(0 1 0) for frequency deviation 

A complete deduction of the Kalman observer can be found in the 
fundamental control theory literature, for example, Brown, Huang, Introduction To 
Random Signals and Applied Kalman Filtering, John Wiley & Sons Inc., 1993, 
which is herein expressly incorporated by reference. 

The non-stationary Kalman observer exhibits a state vector x k which is the 
estimated state vector of the observed system, based on the measurements 1 to Ar-l, 
which minimizes E[(X -x ) 2 ] , where X k is the true state vector. 



The kth iteration of the Kalman observer can be represented by the equation 

below: 

wherein e k is the innovation which is the difference between the measured 



are exchanged, then H p can be set equal to the vector below: 



(10) 



output y k and the predicted output Hx k . 
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Then the covariance of the innovation S k , is the sum of the measurement 
covariance and the prediction covariance and can be represented by the following 
equation: 

S k = HP k H T + R k (11) 



K. = F P H T S ~ l (12) 

k k k k 



The Kalman gain, K k , is then calculated using the following equation: 
The Kalman observer is advanced one time step and a correction based upon 
the calculated innovation and the Kalman gain is made as follows: 



x, , = Fx, + G + KB fTV> 

k+I k k k k k \ x **} 



Then the covariance, P, for x t t is calculated as follows: 



where t fp is the standard deviation of the estimated absolute time. 

y 1 1 ,k +1 

10 For each new iteration of the Kalman observer k, the Kalman observer 

determines the discrete time interval of the prediction T k , measurement y k and a 
measurement uncertainty variance R k . In the general case, all other matrices and 
values can also depend upon the iteration k, but here, such values are constant. If 
no measurement is available, R k is set to infinity, which makes S k equal to infinity. 

15 Thereby, the covariance of the innovation is also set to infinity, and K k = 0, 
x kH = Fkx; + G k and P k+1 = F k P k */ + Q k . 
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As a priori knowledge, additional information is not required except for 
the values of the model matrices F and H, the co variance matrix of the system 
uncertainty Q, the initial state vector x Q , and its covariance matrix P 0 . 

The uncertainty of the frequency of the oscillator, P 22 and P 33 , can also be 
5 adjusted if changes in the environment are detected, e.g. if the temperature falls, 
or if the current consumption of the oscillator increases. Based on the state model 
and the time stamp message exchanged between the node, the Kalman observer 
can be used to predict future values of the system. 

The signaling between two nodes in a network is illustrated in figures 4A 

10 and 4B. Figure 4 A illustrates a plurality of time stamp message exchange periods 
between two exemplary nodes, node A and node B over a message exchange 
interval. Nodes A and B can be constructed in a similar manner to that described 
above with respect to figure 2. Figure 4A illustrates two time stamp message 
exchange periods. In figure 4A, I x represents the time interval between the time 

15 the first time stamp message is transmitted from node A to node B during the first 
time stamp message exchange time period and the time the first time stamp 
message is transmitted from node A to node B during the second time stamp 
message exchange period. Similarly, J x represents the time interval at node B 
which can be related to In the equations below, Jj is defined as the time 

20 interval between the time the first reply time stamp message is transmitted from 
node B to node A during the first time stamp message exchange period and the 
time the first reply time stamp message is transmitted from node B to node A 
during the second time stamp message exchange period. 

Figure 4B is an exploded view of the second time stamp message exchange 

25 time period illustrated in figure 4A. When node A transmits a time stamp 

message 410 at time t, t , it is received by node B at time Tj r . The difference in 
time between the transmission of the first time stamp message by node A and the 
reception of the time stamp message by node B is the transmission delay caused by 
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the network over which the message is transmitted. This transmission delay can 
be represented by A u . 

Figure 5 illustrates various fields in an exemplary time stamp message. 
The time stamp message includes a time of transmission field 510, which contains 
5 the value associated with the counter at the time that the time stamp message is 
transmitted. Field 520 contains a value representing the node estimation of the 
network delay during the last time stamp message exchange. Field 530 contains a 
value representing the elapsed time since the Nth latest time stamp message was 
transmitted when this time stamp message is transmitted, a value which is 

10 represented as x^ Field 540 contains a value for the uncertainty of the interval 
value of field 530, which is represented by the variance value P n . As described 
above, according to one embodiment of the present invention a first sub-message 
contains a sequence number. The second sub-message contains the sequence 
number of the first sub-message (not illustrated) and fields 510, 520, 530 and 540. 

15 As described above, according to exemplary embodiments of the present 

invention, frequency deviation of the oscillator is determined by comparing 
estimations of a time interval. The time interval is bounded by an event which is 
common to the two nodes exchanging time stamp messages. The common event 
can be the start of the transmission of the first sub-message. Alternatively, in a 

20 synchronous network, e.g., a network which operates according to the G.703 
standard, the common event can be the beginning of the frame which directly 
follows the last frame of the time stamp message. 

Referring again to figure 4B, since node B may be performing other tasks 
when the time stamp message is received from node A, node B may not 

25 immediately respond to the time stamp message. Instead, node B transmits the 

reply 420 O x time units after reception of time stamp message 410. The value O , 
is included in the reply time stamp message. Figure 6 illustrates an exemplary 
format for the reply time stamp message which is transmitted in response to the 
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time stamp message. The reply time stamp message includes field 610 which 
contains the time, i.e., the counter value, of when the reply message is 
transmitted. The reply time stamp message also includes field 620 which contains 
the time, O i5 between the reception of the time stamp message at node B and the 
5 transmission of this reply time stamp message to node A. Field 630 contains a 
value corresponding to the amount of time elapsed since the Nth latest reply time 
stamp message was transmitted and this reply time stamp message is being 
transmitted. Field 640 contains a value corresponding to the uncertainty of the 
interval value of field 630. 
10 Upon reception of the reply time stamp message from node B, node A 

calculates the average transmission delay Aj caused by the network. The average 
transmission delay can be calculated using the following formula: 



^ t 2Mr t 2 Nt ' 0 2 N ) 12 (15) 

where t 2Nr is the time that the reply time stamp message was received at node A, 
t 2Nt is the time which the time stamp message was transmitted from node A, and 

15 0 2N is the delay at node B between the reception of the time stamp message from 
node A and the transmission of the reply time stamp message to node A. The 
equation above assumes that the transmission delay is the same in both the node A 
to node B direction as well as the node B to node A direction. However, if the 
transmission delay is not the same in both directions the time/interval transferred 

20 between nodes A and B will have an error of (A 2N r A 2N 2 )/2. 

After calculating the mean transmission delay, node A reports this value to 
node B in message 430. Alternatively, if more time stamp messages are to be sent 
directly after the calculation of the mean transmission delay A, by node A, time 
stamp message 430 can be a time stamp message which includes the mean 



• 



transmission delay instead of reporting the mean transmission delay in a separate 
message. The provision of the mean transmission delay in a time stamp message 
reduces the message load on the network. Any variation in the transmission delay 
can be estimated by sending N time stamps directly after each other and 
5 calculating the variation of A i9 i = N..2N. To minimize this uncertainty, well- 
balanced networks should be used. Also, the time of day the time stamps 
messages are interchanged can be chosen wisely since it is the traffic load that 
causes the variations. The problem is less significant within a network segment 
^ than between network segments. 

10 When all N time stamp messages are transmitted, each node transmits the 

LP* 

u'jl, estimated absolute time of the last transmitted time stamp message. As illustrated 

iSSjl; in figure 4B, one absolute time message is sent in each direction. Figure 7 

; 3 illustrates an exemplary format for the absolute time message. The absolute time 

i'lli message is sent when the frequency deviation of the oscillator has been corrected 

15 for drift. The absolute time message contains field 710 which includes a value 

corresponding to the nodes estimate of the absolute time when the last time stamp 
message was transmitted. Field 720 contains a value corresponding to the 
uncertainty of the estimate of the absolute time value in field 710. 

For every time stamp message sent, the counter value is stored. The 
20 counter value is incremented by the oscillator alone, i.e. it merely counts 

oscillator clock cycles. The time of an interval is therefore the difference in 
relative time between the bounds multiplied by the average frequency of the 
oscillator during that interval. 

An alternative to sending N time stamp messages within a short period of 
25 time is to send the N time stamp messages evenly distributed over the interval, 
e.g., interval 1^ Assuming that the network load is constant over time, this will 
not have any impact on performance. If the network load changes over time, a 
smaller transmission delay spread is achieved if the N time stamp messages are 
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kept together. If the time for the N messages was chosen when there is congestion 
in the network, and the transmission delay estimates show an uneven delay in the 
two directions a new attempt is made shortly thereafter. 

Now that the basic signaling between the nodes has been explained, an 
exemplary method for implementing the inventive time stamp message exchange 
will be described below in connection with figure 8. A more detailed description 
of how the values in each of the steps are calculated will be discussed in more 
detail below. 

Figure 8 illustrates an exemplary method for transmitting the time stamp 
message from a node which is initiating the time stamp message exchange, e.g., 
node A in figures 4 A and 4B. In step 810 node A notes the relative time of 
transmission for the first sub-message, e.g., a message containing only a sequence 
number, of the time stamp message and stores this value. In step 815 the interval 
in time between when the transmitted time stamp message and the time stamp 
message which was transmitted N times ago is calculated using the Kalman 
observer. 

In step 820 node A transmits the second sub-message of the time stamp 
message, which as illustrated in figure 5 contains the time the first sub-message 
was transmitted, the time interval (x,) calculated in step 815, the time interval 
uncertainty (P n ), and the last transmission delay. In step 825 node A waits for a 
reply from node B. In step 830 node A determines whether all N messages for the 
time stamp message exchange period have been transmitted from node A to node 
B. If not all N messages have been transmitted, in accordance with the "No" path 
out of decision step 830, then node A repeats steps 810-825 until it is determined 
that all N messages have been transmitted. This repetitive transmission of N 
messages is used to ensure that the nodes have an accurate estimation of the delay 
caused by the network. 
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If all N messages have been transmitted, in accordance with the "Yes" path 
out of decision step 830, node A transmits a message with the Nth calculated 
transmission delay, in accordance with step 835. In step 840 node A calculates 
the transmission delay variance. In step 845 node A calculates the estimated 
frequency deviation, and updates the state variable at the new frequency point. In 
step 850 node A estimates the absolute time at transmission of the first time stamp 
message from node A to node B, t n t , using the Kalman observer. 

The calculations, and updating of absolute time, is made after the 
calculations, and updating, of the frequency estimate. This is due to the fact that 
the new frequency estimate should be used when estimating the absolute time at 
the transmission of the time stamp messages. In step 855 node A transmits a 
message containing the estimated time of transmission x x and its variance P n . 
When the frequency and time have been updated, the node stores the counter value 
for each time point, the oscillator correction applied at each time point, the 
estimated absolute time at the latest time point and the variance of the estimated 
absolute time at the latest time point. For the latest frequency point, the counter 
value at the frequency point is stored and the state vector of the node at the 
frequency point is stored. 

Figure 9 illustrates an exemplary method for a node receiving time stamp 
messages. In step 905 the node receives the time stamp message sent from 
another node. In step 910 the node notes the relative time of the reception of the 
received time stamp message. In step 913, the node transmits the first sub- 
message of the reply time stamp message. Similar to the first sub-message of the 
time stamp message, the first sub-message of the reply time stamp message 
contains only a sequence number. In step 915 the interval in time between the 
transmitted first sub-message of the reply time stamp message and the first sub- 
message of the reply time stamp message received N times ago is calculated. The 
node also estimates the delay between the reception of the time stamp message and 
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the transmission of the reply time stamp message using the Kalman observer. In 
step 920 the node transmits the reply time stamp message including the delay 
estimated in step 915. In step 925 the node waits for the reception of the next 
time stamp message from the other node. 
5 In step 930 it is determined whether all N time stamp messages have been 

received from the other node. If all N time stamp messages have not been 
received from the other node, in accordance with the "No" path out of decision 
step 930, then the node receives the next time stamp message in accordance with 
step 905. If all N time stamp message have been received from the other node, in 

10 accordance with the "Yes" path out of decision step 930, then the transmission 
delay variance is calculated in accordance with step 940. 

In step 945 the estimated frequency deviation is calculated and the state 
variables are updated at the new frequency point. In step 950 the absolute time at 
the transmission of time stamp x n t is estimated using the Kalman observer. In step 

15 955 a message containing the estimated time of transmission X! and its variance P n 
is transmitted to the other node. 

Now that the overall message transmissions between the nodes has been 
described, a more detailed explanation will be presented of how the values, which 
are inserted in the messages, are calculated by the nodes. As described above, in 

20 order to synchronize the clocks of the two nodes it is necessary to determine the 
transmission delay caused by the network. Since a plurality of messages are 
transmitted between nodes A and B, the transmission delay variance is calculated 
to ensure that the calculation of the transmission delay between the nodes is not 
adversely affected by messages which are stuck in the network. This variance is 

25 then compared with a confidence interval which ensures that the calculations are 
not affected by irregular events. 

As described above, node A can calculate the network delay for one 
message exchange period by subtracting the time that the first time stamp message 
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was transmitted from node A and the amount of delay at node B before the reply 
message is transmitted from the time of reception at node A of the reply message 
from node B as illustrated by the equation below: 

V<V"',,-°,> /2 (16) 



10 



wherein Ai represents the network delay for the ith time stamp message. The 
equation above assumes that the network delay is the same in both the node A to 
node B direction as the network delay in the node B to node A direction, as 
evidenced by the division of the equation by two. Once the network transmission 
delay for the ith time stamp message has been calculated using the equation above, 
the average transmission delay is calculated using the equation below: 



, n *N 

Pa =— £ A (17) 



wherein N is the number of time stamp messages sent during a time stamp 
message exchange period, and n represents the total number of time stamp 
message exchange periods. The variance of the transmission delay for the nth 
time stamp exchange period is then calculated using the formula below: 



, n *N 

=— £ (A -ti. ) 2 (18) 



n *N 

2 



15 



Next, each A { is checked against a confidence interval with a predefined 
confidence level to ensure that time stamp messages which get stuck in the 
network do not adversely influence the calculations of the Kalman observer. If the 
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Ai is outside the confidence interval it is rejected. The confidence interval can be 
represented by the two equations below: 

Abs(\i A -A)<k *s An (dynamic interval) 

Abs(A.)<k 2 (hard limit interval) 

5 wherein the dynamic interval is an adaptive limit which compares the different 
measured delays with each other and the hard limit interval is a predetermined 
interval based on how long of a network delay will still provide a accurate data for 
the receiving node. If a transmission delay A, is not within both the dynamic 
interval and the hard limit interval, then the time stamp message sent during the 

10 ith time stamp message exchange is discarded, kj and k 2 can be predefined or 
vary with the uncertainty of node A's estimate of the absolute time, P n , as 
described below, and/or previous knowledge of the network. If too many time 
stamp messages are not within the confidence interval then it is determined that 
there is too much variance in the network delay to properly synchronize the two 

15 nodes and a new time stamp message exchange period is initiated. 

After verification of the transmission delay, a new average and 
transmission delay is calculated for all of the time stamp messages which are 
within the confidence interval using the equation below: 

^,=^EA. (19) 

wherein Q x represents the set of the time stamp messages which are within the 
20 above described confidence interval during the ith time stamp exchange. Q , can 



Q ] = {J6Z;(n-l) *N<i<>n *N}n{iGZ;A { rejected} 



(20) 



• 



-28- 



be represented by the equation below: 

N/ represents the time stamp messages which are within the set of Q ,. 

The uncertainty of the transmission delay is now calculated for all the time 
stamp messages which are within the confidence interval. The uncertainty of the 
transmission delay can be represented by the variance calculation in the equation 



below: 

where Q x is a group which includes all of the A values which were found to be 
within the confidence interval for the nth time stamp exchange period. 

Now that the transmission delay of the network has been calculated, the 
Kalman observer will calculate the frequency deviation of the oscillator in the 
node. The frequency difference between the two nodes is measured by 
interchanging their measurements of a common interval, Ii and J { , as illustrated in 
figure 3 A. Since the absolute time changes at every interchange of time stamp 
messages, it cannot be used for expressing interval length. Instead, the counter in 
the node is used together with the estimated frequency offset. At transmission of 
the time stamp, t t l and x t h the counter value of the nodes is saved in both nodes. 
N time stamp messages after that, the measured interval is interchanged. Any 
difference of the measurements of the common intervals, after compensation for 
transmission delay and reply time O i? originates from a frequency deviation 
between the nodes. The frequency deviation in fractions of the frequency for the 
ith time stamp message is y 2 i and can be expressed using the equation below: 




1 



(21) 
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wherein I, represents node A's estimate of the interval length for the ith time 
stamp message, / represents the estimated true interval length for the ith time 
stamp message based on both I, and J i5 and J; represents node B's estimate of the 
5 interval length for the ith time stamp message. 

/ and J/ can be expressed using the equations below: 

I=pJ:H 1 -/>)/, (23) 
J=(J-0-A+0 +A ) (24) 

wherein p represents the ratio between the uncertainty of the estimation of the 
interval length at node A and the uncertainty of the interval length at node B for 
the ith time stamp message and can be expressed using the equation below: 

p = Var(I)l( Var{I) + Var{j'^) (25) 

10 wherein Var(Ii) is the variance of node A's estimate of the interval length from the 
true interval length for the ith time stamp message, i.e., the value of the 
uncertainty, and Var^') represents the variance of node B's estimate of the 
interval length from the true interval length for the ith time stamp message. The 
variation of node B's estimate of the interval length for the ith time stamp message 

15 can be represented by the equation below: 

Var^f) = Var(J) + Var{0) + Var(A) + Var{0^ + Va^A ^) - Var(J) + + 0^ (26) 
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Accordingly, Var^') is approximately equal to the variance of J { plus the 
uncertainty of the transmission at time n and time n-1. 

Ji and Var(Ji) are included in the reply time stamp messages. The last 
approximation is valid if the reply time of the time stamp message is small 
compared to the interval. 

The calculation of the variance of y 2J assumes that all variables are 
uncorrelated. It also divides the stochastic variables into a sum of a scalar and a 
normal distributed signal with zero expected value and the variance of the original 
stochastic variable as illustrated by the equations below: 



Var(J ')*Var(J)+Q 2 A +0 2 A , 

v i ' K r A,n A,n -I 

Var(J. U y , .) = Var«iXj u + V, , ,)l> y ,,.) u VariVj , .) + Var(u) , .) « ^ tj Var^ , .) =n* , . Var{J. ) 



* — Vardl- J. )( 1 - 2 ^)) = 




=_L Var{I) + Var(J' )+\{Var&\ -pVp, )^Var{pJ^ jr )) 
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y,2,i N a e 2,1 



Each frequency deviation estimate y 2fi for the ith time stamp message is now 
checked against a confidence interval to ensure that time stamp messages which 
were stuck in the network are not included in the algorithm, the confidence 
interval can be represented by the equations below: 



where k 3 and k 4 can be predefined or vary with P 22 and/or previous knowledge of 
the surrounding nodes. Time stamp messages which are not within both the 
dynamic interval and the hard limit interval are discarded. Typically, k 4 varies 
with the uncertainty of the frequency error, P 22 , and the known maximum possible 
frequency deviation of the oscillator over time. If too many time stamp messages 
were thrown away, the processing ends and a new time stamp message exchange 
period is initiated. 

A frequency deviation estimate y 2 k is now calculated for all N time stamp 
exchange periods by taking the average of the frequency deviations: 



Abs(\x o ~y*> ) K k ,* s 



(dynamic interval) 



Abs(y 2 )<k 4 



(hard limit interval) 




(27) 



wherein Q 2 represents the set of time stamp messages which are within the 
confidence interval during the kth iteration of the Kalman observer and can be 
represented by the equation below: 
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Q ? = {ieZ;(n-l)*N<izn *N}n{ie Z;y 2 rejected} d{ie Z;A. rejected} 



(28) 



N = Entries in Q 

2 2 



(29) 




Next the variance of the frequency deviation for the kth iteration of the 
Kalman observer is calculated using the equation below: 

Var(y 2k ) = Var{^£y 2 ) m 

wherein the variance of the frequency measurement for the kth iteration of the 
Kalman observer Var(y 2 J is equal to the variance of the sum of the frequency 
deviation measurements which are within the confidence interval for all i time 
stamp messages. 

The measurement y 2 k is the average frequency deviation for the kth 
iteration of the Kalman observer in fractions during the time interval. Assuming a 
linear frequency deviation of the oscillator over time, y 2k is the frequency 
deviation at the mid point of the Kalman observer iteration interval, i.e. the new 
frequency estimated is the frequency deviation at the middle of the interval. The 
mid point of the interval is therefore called the frequency point and can be 
calculated using the formula below: 



FP 




(31) 



15 



As will be described in more detail below the state variable of the last frequency 
point is used iterate to the new frequency point. In the last iteration step, the 
measurement y 2k for the kth iteration of the Kalman observer and the variance of 
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the measurement y 2 k are used to update the variables of the state model of the 
system. 

As described above in connection with figure 4B, the last two messages 
transmitted between the nodes during a message exchange interval is the absolute 
5 time message. The node's counter value is used as the relative time sampled at 
transmission and reception of time stamp messages. Based on the information 
received in the absolute time message after the N time stamp messages, all 
counter values received can be converted to absolute time. Based on the updated 
frequency estimate, the node's own counter values can be converted to absolute 
10 time. 

The measurement y M is the estimated absolute time of node B at the time 
of transmission of the ith time stamp message by node A, i.e. t it , the absolute 
time of transmission of the ith time stamp message can be represented the 
equation below: 

y =x -O -A ~x -O -A (32) 

7 1 ,i i,t i i,l i,t i i W^/ 

15 Next the variance of the absolute time of transmission for the ith time 

stamp message is calculated and can be represented by the equation below: 

Var(y i ^0 2 + Var{0) + Var(A.) (33) 

The innovation fi is the difference in absolute time between node A and 
node B. It, and its variance can be expressed by the equations below: 

x l.i J l,i l,i i>t * i i.t W*+) 



Var(y\ } ) =0 2 z +Var(0 .) + Kar(A.) +Var(t. f ) 



(35) 
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The average absolute time and the variance of the absolute time for all n 
time stamp message exchange periods can be expressed by the equations below: 

j n *N 

\>„ .;,=T7 £ \ t (36) 



, n *N 

2 nli =- £ Vari^p (37) 



Since the time between the first time stamp message and its reply, 0 { , is 
small, its variation is neglected. Since all N time stamp messages are transmitted 
5 during a short time period, the same variance of the estimate of absolute time can 
be used for all N time stamp message. Alternatively, if the system is built for 
which this approximation is inappropriate, the absolute time message must consist 
of all these variances. The variance of node A's estimate of absolute time is P n . 
The variance of node B estimate of absolute time, a T 2 » is received in the Absolute 
10 Time message. 

Each innovation j is checked against a confidence interval to ensure that 
time stamp messages stuck in the network are not included in the determination of 
absolute time. The confidence interval can be represented by the equations 
below: 



15 Abs (V- V i n'^i ? <k 5* s 7] i i (dynamic interval) 
Abs(r\ j .)<k 6 (hard limit interval) 

where k 5 and k 6 can be predefined or vary with the uncertainty of node A's 
estimate of the absolute time P u , and/or previous knowledge of the network. 

One innovation is now calculated for all N time stamp messages by taking 
20 the average innovation for all time stamp messages: 
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e,. t = ^En,, (38) 

3 U Q 

The innovation of absolute time is valid at the time point. Q 3 is the set of all time 
stamp messages which are within the confidence interval and can be represented 
by the equation below: 

Q 3 = {ieZ\(n-\)*N<i<n *N}C\{i€Z\X\ } , rejected}n{i€ Z;A .rejected} (39) 

7^ '= Entries in Q 3 (40) 

Next, the uncertainty of the node's estimation of the absolute time is 
calculated. The uncertainty of the node's estimation of the absolute time can be 
represented by the variance equation below: 

Var{Z i k ) = Kar(—E tj ) = ^-Var(r\) = - [ -(0 2 +0 2 +P ) (41) 
l,k i.t n,n v ) 

3 1 3 3 

The estimated state variable, including absolute time, at the time point was 
estimated after updating the state variable at the new frequency point. It is now 
updated at the time point by using the innovation e n and its variance, and T k set to 
0. The new state variable x l and the matrix component P u then become the 
optimal estimate of absolute time and the node's uncertainty of the absolute time. 

By calculating and distributing the estimated transmission delay, a 
comparison of a common time and a common interval can be made (except for the 
variations of the transmission delay). Note that the time 0 { of the replying node 
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must be short enough not to cause any extra uncertainties due to the oscillator 
drift of that node. 

The exchange of time stamp messages and the calculations of absolute time 
and frequency deviation have, for ease of illustration, been described above as 
5 involving only two nodes. However, as described above in connection with 
figure 1, a node may exchange time stamp messages with several nodes. For 
example, referring now to figure 1, node A may exchange time stamp messages 
with node B and node C. However, the exchange of time stamp messages 
between nodes A and B may occur more frequently than the exchange of time 

10 stamp messages between nodes A and C. Accordingly, the time period for the 

exchange of time stamp messages between nodes A and B will be shorter than the 
time period for the exchange of time stamp messages between nodes A and C. 

Figure 10 illustrates the frequency deviation of node A's oscillator and the 
time and frequency points for the exchange of time stamp messages with nodes B 

15 and C. Time points TF AB1 , TP AB2 , TP AB3 and TP AB4 represent time points in the 
exchange of time stamp messages between nodes A and B and time point TP AC1 
represents a time point in the exchange of time stamp messages between nodes A 
and C. As described above, at each time point in the exchange of time stamp 
messages between nodes A and B, i.e., TP AB1 , TP AB2 , TP AB3 and TP AB4 , node A 

20 will adjust the frequency of its oscillator based upon the estimated frequency 
deviation. Accordingly, during the time period between time 0 and time point 
TP AC1 node A will have adjusted its oscillator for frequency drift three times, i.e., 
at time points TP AB1 , TP AB2 and TP AB3 . Therefore, to properly determine the 
absolute time between time 0 and time point TP AC1 , the Kalman observer will have 

25 to take into consideration the frequency adjustment at time points TP AB1 , TP AB2 , 
TP A B3- Using the calculated absolute time between time 0 and time point TP AC1 
the Kalman observer can estimate the frequency drift of node A's oscillator during 
this time period. 
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Figure 1 la illustrates a plurality of time points in message exchanges 
between node A and nodes B and C. Figure 11a illustrates time stamp message 
exchanges between nodes A and B delimited by time points TP AB1 , TP AB2 , TP AB3 , 
and a time stamp message exchanges between nodes A and C message delimited 
5 by time points TP AC1 and TP AC2 . Assume that frequency point FP was calculated 
during a time stamp message exchange period between nodes A and B during the 
time period delimited by TP AB2 and TP AB3 . Now assume that node A has 
performed a time stamp message exchange with node C, during the time interval 
between time points TP AC1 and TP AC2 . As discussed above with regard to figure 

10 8, in step 815 the interval in time between the transmitted message and the 
message transmitted N time ago is calculated using the Kalman observer. 
However, the current frequency point is in the middle of the time stamp message 
exchange between nodes A and B. Accordingly, it is necessary to determine the 
interval between the time points TP AC1 and TP AC2 . 

15 Figure 12 illustrates an exemplary method for estimating a time interval 

during a time stamp message exchange between two nodes, delimited by two time 
points, using a frequency point which was determined based on a time stamp 
message exchange with a third node. In step 1205 the Kalman observer begins 
from the frequency point. In step 1210 the Kalman observer sets the estimation of 

20 the absolute time x, and the uncertainty of the estimation of the absolute time P u 
equal to zero. In step 1215 the Kalman observer iterates towards the beginning of 
the interval to the next time point. In step 1220 the Kalman observer updates the 
state variables x 2 and x 3 and their respective uncertainty values P 22 and P 33 based 
on any adjustment of the oscillator frequency performed at the time point. The 

25 Kalman observer uses the difference in counter values between the time points as 
the number of oscillator cycles between two update, T k . Since the Kalman 
observer is iterating backwards towards the beginning of the interval, T k will be 
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negative in this step. In step 1225 the Kalman observer determines whether the 
current time point is the time point at the beginning of the interval. 

If the time point is not the time point at the beginning of the interval, in 
accordance with the "No" path out of decision step 1225, the Kalman observer 
5 iterates towards the beginning of the interval to the next time point. If the time 
point is at the beginning of the interval, in accordance with the "Yes" path out of 
decision step 1225, the Kalman observer restarts at the frequency point and 
maintains the values of x } and P u in accordance with step 1230. 

In step 1235 the Kalman observer iterates towards the end of the interval 

10 to the next time point. At this time point the Kalman observer updates the state 
variables frequency error x 2 , the frequency drift per time unit x 3 and their 
respective uncertainty values P 22 and P 33 based on any adjustment of the oscillator 
frequency performed at the time point in accordance with step 1240. The Kalman 
observer uses the difference in counter values between the time points as the 

15 number of oscillator cycles between two updates, T k . In step 1245 the Kalman 

observer determines whether the current time point is at the end of the interval. If 
the time point is not at the end of the interval, in accordance with the "No" path 
out of decision step 1245, the Kalman observer iterates towards the end of the 
interval to the next time point in accordance with step 1235. If the time point is 

20 at the end of the interval, in accordance with the "Yes" path out of decision step 
1245, then the value of x t is used as the interval length and the value of P n is 
used as the uncertainty of the interval length in accordance with step 1250. 

Now assume that node A has adjusted the frequency point of the Kalman 
observer based on a time stamp message exchange with node C, as illustrated by 

25 the frequency point FP in figure lib. When node A finishes a time stamp 

message exchange with node B, e.g., at time point TP AB4 , the node will have to 
estimate the interval between time points TP AB3 and TP AB4 . However, in this case 
the frequency point is not in the interval between TP AB3 and TP AB4 . 
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Figure 13 illustrates an exemplary method for estimating an interval when 
the frequency point is not within the interval. In step 1305 the Kalman observer 
begins at the frequency point. In step 1310 the Kalman observer iterates to the 
first time point after the frequency point. In step 1315 the Kalman observer 
5 updates the state variables x 2 and x 3 and their respective uncertainty values P 22 and 
P 33 based on any adjustment of the oscillator frequency performed at the time 
point. The Kalman observer uses the difference in counter values between the 
time points as the number of oscillator cycles between two updates, T k . In step 
1320 the Kalman observer iterates to the next time point. In step 1325 the 
10 Kalman observer determines whether this time point is at the beginning of the 
interval. 

If the time point is not at the beginning of the interval, in accordance with 
the "No" path out of decision step 1325, the Kalman observer updates the state 
variables x 2 and x 3 and their respective uncertainty values P 22 and P 33 based on 

15 any adjustment of the oscillator frequency performed at the time point and uses 
the difference in counter values between the time points as T k in accordance with 
step 1315. If the time point is at the beginning of the interval, in accordance with 
the "Yes" path out of decision step 1325, the Kalman observer sets the interval 
length x x and the variance of the interval length P u equal to zero in accordance 

20 with step 1330. 

The Kalman observer then begins to iterate towards the end of the interval. 
Accordingly, in step 1335 the Kalman observer iterates to the previous time point. 
In step 1340 the Kalman observer updates the state variables x 2 and x 3 and their 
respective uncertainty values P 22 and P 33 based on any adjustment of the oscillator 

25 frequency performed at the time point. The Kalman observer uses the difference 
in counter values between the time points as the number of oscillator cycles 
between two updates, T k . In step 1345 the Kalman observer determines whether 
the time point it is currently at is the end of the interval. 
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If the time point which the Kalman observer is currently at is not the time 
point at the end of the interval, in accordance with the "No" path out of decision 
step 1345, the Kalman observer iterates to the next time point on the way to the 
end of the interval in accordance with step 1335. If the Kalman observer is at the 
5 time point which is at the end of the interval, in accordance with the "Yes" path 
out of decision step 1345, then the value of x l is used as the interval length and 
the value of P n is used as the variance of the interval length in accordance with 
step 1350. 

As discussed above with respect to figure 8, in step 850 the absolute time 

10 of transmission of first time stamp message during a time stamp message 

exchange is calculated. Figures 14 and 15 illustrate the estimation of the absolute 
time for a time point in an exchange of time stamp messages between, for 
example, nodes A and C, when node A has performed several time stamp 
exchanges with node B during the time period of the time stamp message 

15 exchange between nodes A and C. Referring now to figure 14, in step 1410 the 
Kalman observer begins at the frequency point (FP of figure 15) of the time 
period between the end of last time stamp message exchange between nodes A and 
C (not shown in figure 15) and the end of the current time stamp message 
exchange between nodes A and C (New Point in figure 15). 

20 In step 1420 the Kalman observer performs an iteration from the frequency 

point (FP in figure 15) to the next time point after the frequency point (Old TPj of 
figure 15). This is illustrated in figure 15 as Iteration 1. In step 1430 the Kalman 
observer updates the state variables x 2 and x 3 and their respective uncertainty 
values P 22 and P 33 based on any adjustment of the oscillator frequency performed 

25 at the time point. The Kalman observer will then use the difference in counter 
value as the number of oscillator cycles between two updates, T k . In step 1435 
the Kalman observer iterates to the next time point. In step 1440 it is determined 
whether this time point is the latest time point for which the state variables have 
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been updated. For example, referring now to figure 15, if the Kalman observer 
advances from Old TPi to Old TP 2 , then Old TP 2 is not the latest time point. 
However, if the Kalman observer iterates from Old TP 2 to Old TP 3 , then Old TP 3 
is the latest time point. 

Accordingly, if the Kalman observer determines that this time point is not 
the latest time point, in accordance with the "No" path out of decision step 1440, 
the Kalman observer will update the state variables x 2 and x 3 and their respective 
uncertainty values P 22 and P 33 based on any adjustment of the oscillator frequency 
performed at the time point use the difference in counter value as T k in accordance 
with step 1430. If the Kalman observer determines that the time point is the 
current time point, in accordance with the "Yes" path out of decision step 1440, 
the Kalman observer will update x u x 2 , x 3 and P n based on the time stamp 
exchange between nodes A and B in accordance with step 1450. In step 1455 the 
Kalman observer iterates from the latest time point to the current time point. In 
step 1460 the Kalman observer will determine the absolute time of the time period 
ending at New Time point using a Kalman iteration. 

Figure 16 illustrates an exemplary method for estimating the frequency of 
the oscillator at a desired point in time. In step 1610 the Kalman observer begins 
at the frequency point. In step 1620 the Kalman observer iterates to the first time 
point after the frequency point. In step 1630 the Kalman observer updates the 
state variables x 2 and x 3 and their respective uncertainty values P 22 and P 33 based 
on any adjustment of the oscillator frequency performed at the time point. The 
Kalman observer uses the difference in counter values between the time points as 
the number of oscillator cycles between two updates, T k . In step 1640 the Kalman 
observer determines whether there are more time points between the current time 
point and the desired point in time. If there are more time points between the 
current time point and the desired point in time, in accordance with the "Yes" 
path out of decision step 1640, the Kalman observer iterates to the next time point 



• 
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in accordance with step 1620. If there not any more time points between the 
current time point and the desired point in time, in accordance with the "No" path 
out of decision step 1640, the Kalman observer will estimate the frequency of the 
oscillator at the desired point using the updated state variable. 
5 Once the frequency of the oscillator is determined at a point in time and 

the variance of the oscillator from the estimated frequency has been determined, 
the oscillators frequency is updated. The regulation of the voltage controlled 
oscillator can be performed using a simple PI regulator based on the estimated 
frequency error, state variable x 2 , Of course, one skilled in the art will recognize 
10 that other types of regulators can be implemented to update the frequency of the 
oscillator. 

The Kalman observer will first estimate the frequency deviation. Based on 
the estimated frequency deviation, the regulator will update the oscillator 
accordingly. For example, a simple regulator can be represented by the equation 

15 V vco =V vco +k 7 *k 8 *x 2 , where k 7 is the proportional constant "volts/frequency 
fraction", and k 8 represents the cut-off frequency of the regulator. After the 
frequency deviation of the oscillator is updated the node will store the updated 
frequency, which can be represented by the equation FreqCorrection: =k 8 *x 2 . 

As described above, every time an estimation of time or frequency passes 

20 the point of where the control voltage was updated, e.g., a time point, the state 
variables x 2 and x 3 as well as the uncertainty of the estimation of the state 
variables P 22 and P 33 are updated. The updates of these variable can be 
represented by the equations below: 

x -x -FreqCorrection(+FreqCorrection if backwards in time) (42) 
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P 22 =P 22 +Fre ^ Correction 2 * Var ( k ? ) (43) 

Changes to x 3 and P 33 will depend on the type of oscillator used in the 
node. One method for modeling the drift of the oscillator's frequency is to 
assume that the drift in hertz per second continues independent on changes in 
control value, and leave x 3 and P 33 unchanged. 
5 Up to this point it has been assumed that the absolute time and the 

deviation of the frequency provide an acceptable estimate for correcting the 
frequency deviation of the oscillator. However, if a node is exchanging time 
stamp messages with a node with an inaccurate oscillator, the absolute time and 
estimated deviation of the frequency will be incorrect and using these values will 

10 cause the node's oscillator to drift farther from the correct frequency. 

Accordingly, the node will supervise its state model to determine if the 
uncertainty of the frequency and the absolute time are within predefined limits. 
Exemplary equations for determining whether the uncertainty of the frequency and 
the absolute time are within predefined limits can be represented by the equations 

15 below: 

^*(* 2 ) + V^ <k io (44) 

wherein k 9 = 1.65 for 95% confidence and k 10 is the limit. 

Abs(x i )+k u *JiP ii ) <k n (45) 

wherein k u = 1.65 for 95% and k 12 is the limit. 
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If X! and x 2 are not within the confidence interval, and if time stamp 
exchanges with other nodes does not correct the state variables within a 
predetermined period of time, the node sends an alarm to the operator. In 
response, the operator can then either chose to ignore the alarm, shut down the 
node or change the set of nodes with which the node may interchange time stamp 
messages with. 

The node can also supervise the values predicted by the Kalman observer 
by checking that each of the received estimates are within a confidence interval. 



wherein k 14 is set to 1.7 if N = 30 and 95% confidence is desired. 

If the difference in absolute time or frequency is outside the confidence 
interval, an alarm is sent to the operator. The node itself will not be able to 
determine whether it, or its peer, has an accurate frequency. However, the 
operator can, based on the alarms received from all involved nodes, determine 
which node/nodes are probably malfunctioning. Alternatively, a node with a very 
stable frequency reference, such as a GPS receiver, can be used to determine if 
nodes are sending inaccurate estimations of absolute time and frequency. For 
example, the node with the very stable frequency reference can occasionally 
compare its estimation of a time interval with the other nodes estimation of the 
same time interval. Based this comparison, the node with the very stable 
oscillator can determine which nodes are providing frequency deviation estimates 



Abs(e jk )<k ]3 *(JiVar(e ]k ))) 



(46) 



wherein k 13 is set to 1.7 if N = 30 and 95% confidence is desired. 



AbS (y 2 .r X 2) <k 14<ft Var &2, k > +P 22» 



(47) 
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which are causing a group of nodes to drift farther from the correct frequency. 
The node with the very stable oscillator can then initiate a time stamp message 
with the nodes which are providing the inaccurate estimates to correct the 
frequency drift of these nodes. 

Figure 17 illustrates an exemplary grouped network for implementing the 
present invention. A grouped network is a network where nodes are grouped 
together and share a single synchronization source for synchronizing all of the 
radio base stations. Accordingly, time stamp messages can be exchanged between 
the groups to synchronize one group with another group. 

Within a group, any type of synchronization reference can be used, e.g. an 
AC network or a physical frequency reference network. The absolute time, and if 
necessary, the absolute frequency of the internal reference, can be calibrated using 
the above described methods between the groups. If a group is in a building or 
any other well-defined sub-network, the present invention provides a good 
alternative for the internal synchronization of the group when the time stamping is 
done on physical layer. 

In between calibration from the other groups, the frequency drift (and 
accumulation time drift) inside the group will be the average of the drift of all 
oscillators. Accordingly, in a group, the oscillators will tend to have the same 
frequency drift. Accordingly, if the nodes are radio base stations, a mobile would 
not have any problem performing a hand over within a group since all of the radio 
base stations within a group will have the same amount of frequency drift. Of 
course one skilled in the art will recognize that if the calibration between the 
groups has not occurred for some time the oscillator frequencies of the groups 
may drift apart and a mobile station may encounter handover problems in a 
handover between groups. 

One advantage of grouped nodes is that if any of the nodes within an 
group is equipped with a better oscillator, all of the nodes in the group will have 
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more accurate oscillators and the total drift of the group will be as good as the 
drift of the best oscillator. After the nodes have corrected their oscillators for the 
frequency drift, a system operator can monitor the uncertainties of frequency and 
absolute time for each group and add any necessary extra oscillators or absolute 
time servers to correct any deficiencies in the system. 

The exchange of time stamp messages can improve the startup of a new 
node in a group. For example, assume that node Al has just been placed in the 
system. Initially, node Al receives a list of nodes, including expected 
transmission delays to each node, from the central node. Next, node Al requests 
time stamp messages from A2 to quickly tune its oscillator. 

According to the exemplary embodiment of figure 17, A3 contains a 
stratum 2 oscillator. Accordingly, A2 will be well tuned due to the exchange of 
time stamp messages with node A3. Since Al and A2 are connected to the same 
HUB, the transmission delay variation between nodes Al and A2 is practically 
zero. Therefore, node Al tunes in to the same frequency as node A2 very 
quickly. Once node Al is tuned, and the temperature of the oscillator has 
stabilized, node Al will begin to request time stamp message from node A3. 
From a performance point of view, if node Al and node A2 are connected to the 
same HUB, Al may just as well continue to request time stamps from A2. 
However, since passing time stamp messages from nodes A3 to node Al via node 
A2 will increase the uncertainty of the time interval passed to node Al, it may be 
preferable to have node A3 exchange time stamp messages with both nodes Al 
and A2 directly. Only one of the nodes in the A group needs to request time and 
frequency information from the other groups. Typically, this would be the node 
with the better oscillator, A3. 

Another exemplary implementation of the inventive time stamp exchange 
methods is in a peer to peer network. In a peer to peer network all of the nodes 
have stratum 2 oscillators and one of the nodes will have a GPS receiver. The 
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nodes with the stratum 2 oscillators will exchange time stamp messages with the 
node containing the GPS receiver for both absolute time and for frequency 
deviation. According to this embodiment, time stamping can be performed on a 
higher layer, e.g., the application layer. Since each node contains a stratum 2 
oscillator, the nodes will not have to exchange time stamp messages as often as in 
the embodiment described above in figure 17. This results in a low traffic load 
and less delays in the network. However, placing stratum 2 oscillators in every 
node will result in a more expensive system than the system described in 
connection with figure 17. 

Figure 18 illustrates yet another exemplary implementation of the present 
invention. The embodiment of figure 18 may be implemented in an Internet 
Protocol (IP) network. Accordingly, the embodiment of figure 18 may be an 
ordinary data network and the nodes need not be radio base stations. The 
network 1800 includes a server 1810 which contains a time server 1820. The 
network 1800 also includes switches 1825, 1835, 1845 and 1855, and nodes 1837, 
1839, 1847, 1849 and 1857. 

In an IP network which includes switches, time server 1820 is typically 
calibrated using a GPS receiver. Alternatively, if the network does not require 
absolute time, but only requires a stable frequency reference, then time server 
1820 only requires a high quality oscillator. In an IP based network which does 
not have any routers, such as switched network 1800, only time stamp messages 
transferred through the network without being queued in any of the switches are 
used. All queued time stamp messages are discarded. Whether a message has 
been queued can be determined using either a confidence interval or by calculating 
the transmission delay. Using a confidence interval will not require reply time 
stamp messages except during initialization of the node. According to an 
exemplary embodiment of the present invention, the time stamp messages can be 
exchanged once every second. To decrease the risk of continuous collisions 
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between messages transferred to the different nodes, a pseudo random sequence 
for transferring the messages to the node could be used. 

According to one exemplary embodiment, in network 1800 there is no 
traffic sent between the nodes. Instead, all traffic is sent to and from the server 
1810. Since server 1810 controls the amount of traffic sent downstream to the 
nodes, the time server 1820 can send time stamp messages to the nodes without 
risk that they will end up in queues in the switches. Accordingly, any queuing of 
messages will be performed at the server 1810 and the transmission delay from 
the time server 1820 to one of the nodes will be constant. 

When a network 1800 is started up, the nodes exchange a series of time 
stamp messages with the time server. The estimated transmission delay of each of 
the time stamp messages is sorted to determine the smallest estimated transmission 
delay which is used as the transmission delay for the network. Time stamp 
messages which have not been queued in a switch will have the smallest 
transmission delay. This transmission delay is maintained for the network until 
the network architecture is changed. Since the nodes are adjusting their 
oscillators for frequency drift, and the time server is not adjusting its oscillator, 
the nodes do not need to send reply time stamp messages. However, one skilled 
in the art will recognize that if supervision of the nodes is desired then return time 
stamp messages can be implemented. Alternatively, if no accurate absolute time 
is necessary, the delay from the time server to each node can be set by the system 
operator since the operator knows the number of switches between nodes and the 
delays in each switch. 

Another exemplary embodiment of network 1800 is to allow messages to 
be sent directly between the nodes without requiring the messages to travel to the 
server 1810. According to this embodiment, messages may be delayed as a result 
of being queued in the switches. However, the estimation of transmission delay 
as described above with regard to figure 4B is not performed. Instead, the 
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smallest estimated delay for the network is saved in each node and used to 
validate time stamps. The confidence interval will be based on the state variable 
of the Kalman observer. Alternatively, the delays in the network can be 
averaged. This is particularly suited in networks where the message length is 
limited and the switches implement prioritization of messages. 

The difference between the two embodiments illustrated in figure 18 and 
the earlier description of the grouped network is that only one time server is 
required. Therefore, it is not necessary to have a separation of time and 
frequency. In addition the Kalman observer's algorithms can be simplified. For 
example, since the nodes are only exchanging time stamp messages with the time 
server 1820, there will be no old time points between the frequency point and the 
current time point. Further, since the time stamp messages may be transmitted 
every second, the frequency point can be estimated to be at the current time point 
without any appreciable loss in performance of the algorithms for determining the 
drift of the oscillator. In addition, the time stamping in the embodiments 
described in connection with figure 18 can be performed on the physical level. 

Although the present invention has been described as exchanging time 
stamp messages, one skilled in the art will recognize that other messages may be 
necessary e.g. to agree on message formats. In addition, one skilled in the art 
will recognize that procedures and messages may be necessary to accept/reject 
interchange of time stamp messages. However, these messages are clearly within 
the skilled of the ordinary artisan. 

The present invention has been described by way of exemplary 
embodiments to which the invention is not limited. Modifications and changes 
will occur to those skilled in the art without departing from the spirit and scope of 
the invention as defined in the appended claims. 



